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BACKGROUND OF THE INVENTION 
5 [01] Factory automation networks have traditionally utilized proprietary 

protocols specially designed to facilitate real time coordination between master and slaves. 
For example, in an automotive application, robots may perform simultaneous operations on a 
work piece and have to be precisely synchronized in time. 

[02] Recently, interest in using Ethernet in factory automation has grown 
10 due the inclusion of inexpensive Ethernet Network Interface Cards (NICs) on most personal 
computers and the low costs of components due to commoditization of Ethernet. 

[03] Thus, the need for precise synchronization between slaves has 
challenged network designers utilizing Ethernet in Factory Automation environment. One 
effort for meeting this challenge is the IEEE 1588 Standard precision Time Protocol (PTP) 
1 5 which defines a method for sub-microsecond synchronization of the clocks in sensors, 
actuators, and other terminal devices on a standard Ethernet-based network or other 
distributed application utilizing commercially available technology. 

[04] In PTP each terminal device has a precision clock that provides a local 
time source. Thus, if a master requires two slave devices to perform actions at time tx, it 
20 sends a message to each slave device including the time tx. However, each slave device will 
perform the action at tx referenced to its local clock. If the clocks on the slaves are not 
synchronized then the operations will not be performed simultaneously. 

[05] PTP utilizes two phases to synchronize the clocks. In the first phase 
the difference between the master clock and slave clock is corrected without taking 
25 transmission delay into account. PTP utilizes two messages to implement this step. First a 
SYNC message is transmitted by the master at a precise time and the slave records the time 
of receipt of the message with its local clock. The master then transmits a follow up message 
that contains the exact time of transmission of the SYNC message according to the master 
clock. The slave utilizes its recorded time of receipt of the SYNC message and the 
30 information in the follow up message so adjust the time indicated by its local clock to be the 
same as the master clock. 

[06] However, the delay introduced by the network has not been 
compensated so that the master and slave clocks still differ by the delay value. To 



compensate for this delay, in the second phase the slave sends a delay request message to the 
master and records the time of transmission based on the slave clock. The master then time 
stamps the received delay request packet at the time of receipt indicated by the master clock 
and sends the time stamp to the slave in a delay response message. The slave utilizes the 
5 recorded time of transmission of the delay request message and the time stamp to adjust its 
local clock to compensate for transmission delay. 

[07] As is apparent from the above, the PTP synchronization can be no 
more accurate the uncertainty in the times of transmission of the SYNC and delay request 
messages. However, in switches, routers, and other network infrastructure devices this time 
10 of transmission is difficult to precisely measure during heavy load or overload conditions. 

[08] In order to synchronize clocks on two different devices using a 
network protocol, one has to account for all significant time loss in the network protocol. In 
the case of a 1588 implementation over TCP/IP on Ethernet, there is time loss in a few areas: 

1 . A first delay is due to the time it takes a packet prepared to be sent by the 1588 PTP to 
1 5 make it through the TCP/IP stack. 

2. A second delay is due to the packet having to wait its turn to be transmitted out of the 
switch because there are queues in switches 

[09] Accordingly, techniques for implementing PTP on switches, routers, 
and other network interface structures are the being investigated by engineers working on 
20 applying Ethernet to Factory Automation environments. 

BRIEF SUMMARY OF THE INVENTION 
[10] In one embodiment, a selected transmit queue on a switch is disabled 
so that all packets are flushed from the selected transmit queue and a timing message is 
enqueued in the selected transmit queue. All other transmit queues are also disabled to flush 
25 all previously enqueued packets from the queues. The selected transmit queue is then 
enabled and the timing message is transmitted at a precisely recorded time. Since the 
selected transmit queue and all other transmit queues have been previously flushed there is no 
delay caused by waiting for previously enqueued packets to be transmitted from the selected 
transmit queue. 

30 [11] In another embodiment of the invention, a timer on the switch is used 

to count time and is read to determine the time that the timing message is transmitted. 

[12] In another embodiment of the invention, in another embodiment of the 
invention, an interrupt time on the 
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[13] Other features and advantages of the invention will be apparent in view 
of the following detailed description and accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 [14] Fig. 1 is a depiction of a factory automation network; and 

[15] Fig. 2 is block diagram depicting an interface in a switch. 

DETAILED DESCRIPTION OF THE INVENTION 
[16] Reference will now be made in detail to various embodiments of the 

10 invention. Examples of these embodiments are illustrated in the accompanying drawings. 
While the invention will be described in conjunction with these embodiments, it will be 
understood that it is not intended to limit the invention to any embodiment. On the contrary, 
it is intended to cover alternatives, modifications, and equivalents as may be included within 
the spirit and scope of the invention as defined by the appended claims. In the following 

1 5 description, numerous specific details are set forth in order to provide a thorough 

understanding of the various embodiments. However, the present invention may be practiced 
without some or all of these specific details. In other instances, well known process 
operations have not been described in detail in order not to unnecessarily obscure the present 
invention. 

20 [17] Fig. 1 depicts an example of how a factory automation network might 

be set up. An assembly line may contain 20-30 robotic welders 20 grouped into work 
functions. It may be decided that since the control equipment needs to talk to all the welders, 
all welders and control equipment would be assigned to the same VLAN. However, in some 
cases where the welders may need to be managed into subgroups (i.e. frame, door panel, 

25 hood and trunk), where each of these subgroups is assigned its own VLAN. 

[18] In this example, three robotic welders 20a, b, and c are coupled to first 
switch 22. A master clock on the switch is utilized to synchronize the clocks on each of the 
three robotic welders so that the welders can operate together to perform complicated 
operations. 

30 [19] A typical switch configuration including a chassis, which contains 

basic components such as power supply, fans, slots, ports and modules that slide into the 
slots. The modules inserted into the slots are line cards which are the actual printed circuit 
boards that handle packet ingress and egress. Line cards provide one or more interfaces over 
which traffic flows. Thus, depending on the number of slots and interfaces, a router can be 
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configured to work with a variety of networking protocols. Soma switches are fixed 
configuration switches that do not use line cards to implement interfaces. 

[20] As depicted in Fig. 2, each interface includes transmit and receive 
memories which are organized logically into transmit and receive queues. For example, each 
5 interface in this embodiment includes four transmit queues. Enqueued Packets that are 

transmitted based on some policy, e.g., round robin weighted round robin, that may take into 
account Quality of Service and other factors. A processor and interrupt timer are also 
available to the interface. 

[21] For example, packets enqueued in transmit queue 1 (SYNC_Q) may be 
10 assigned the highest priority and be transmitted first regardless of the number of packets 
assigned to the other transmit queues. In implementing the above PTP synchronization 
protocol the Sync_Req packet would be enqueued in such a high priority transmit queue if it 
existed. 

[22] However, if packets are already in SYNC_Q when the Sync_Req 

1 5 packet is enqueued then the transmission of the SyncJEteq packet will be delayed by a non- 
deterministic time interval while preceding packets in SYNC_Q are being transmitted. Also, 
the transmission of these packets maybe interleaved with the transmission of packets from 
other transmission queues. Thus, the actual time of transmission of the SyncReq message 
by the master can not be accurately measured. 

20 [23] In one embodiment of the invention, the time of the transmission of the 

Syncjleq packet is determined by first reading the time on the local Master clock and then 
reading a first timer value (e.g., count value) on an interrupt timer. The time read from the 
Master clock is utilized as a base time value. 

[24] The SYNC_Q is then disabled so that no other packets are enqueued 

25 therein and all packets are flushed from the SYNC_Q. Then a Sync Req packet is enqueued 
in SYNC_Q and is assured that it will be the first packet transmitted when SYNC_Q is 
enabled since all the previously enqueued packet in the SYNC_Q have been flushed. 

[25] All other transmit queues are then disabled and the SYNC_Q is not 
enabled until a selected time interval, e.g. 200 microsecond, elapses to allow all transmit 

30 queues to transmit previously enqueued packets. A second timer value is read and the 
SYNC_Q is enabled to transmit the Sync_Req packet. The time of transmission of the 
Syncjleq packet is determined by calculating the difference between the first and second 
timer values and adding the difference to the base time value. The time of the Sync__Req 
packet transmission is then transmitted to the slave in a follow up message. 
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[26] Since all transmit queues are flushed prior to transmitting the 
SyncReq packet, the non-deterministic time interval has been eliminated and the time of 
transmission can be more accurately measure. 

[27] The following is an example of psuedo-code for performing the above- 
5 described embodiment of a switch designed and manufactured by the assignee of the present 
application: 

1588 Algorithm Master Clock: 
Disable SYNC_Q 
Read NTPJTIME (GROSS TIME) 
1 0 Read timer interrupt time (FINE TIME) 

Make Sync Req packet 
Enqueue Sync_Req packet to SYNC_Q 
Disable all non SYNC queues 

Wait -200 usee so that all packets are drained out of all queues 
15 Do the following in interrupt context: 

Read timer interrupt time 

Enable SYNC_Q 
Enable all queues 

[28] Only two instructions, Read timer interrupt time and Enable SYNC_Q, 
20 are performed in the interrupt context between the time of reading the second timer value and 
the time of transmission of the Sync_Req packet. The time of executing these instructions is 
negligible compared to other timing uncertainties. The enable all queues instruction is 
executed subsequent to transmission of Sync Req and does not affect the timing uncertainty. 

[29] The invention may be implemented as hardware or a combination of 
25 hardware and/or program code, stored on a computer readable medium, that is executed by a 
digital computer. The computer readable medium may include, among other things, 
magnetic media, optical media, electro-magnetic fields encoding digital information, and so 
on. 

[30] The invention has now been described with reference to the preferred 
30 embodiments. Alternatives and substitutions will now be apparent to persons of skill in the 
art. For example, the above described embodiment has been described implemented in a 
switch it will be apparent to persons having skill in the art that other network devices, such as 
a router, bridge, switch, layer 2 or layer 3 switch, gateway, etc., can be utilized to implement 
the invention. Accordingly, it is not intended to limit the invention except as provided by the 
35 appended claims. 
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